Kaleidoscope of exotic quantum phases in a frustrated XY model 
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The existence of quantum spin liquids was first conjectured by Pomeranchuk some 70 years ago, 
who argued that frustration in simple antiferromagnetic theories could result in a Fermi- liquid- like 
state for spinon excitations. Here we show that a simple quantum spin model on a honeycomb 
lattice hosts the long sought for Bose metal with a clearly identifiable Bose surface. The complete 
phase diagram of the model is determined via exact diagonalization and is shown to include four 
distinct phases separated by three quantum phase transitions. 
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We learn early in our education that as matter is cooled 
down to low temperatures it normally experiences transi- 
tions into ordered states of various kinds-crystalline solid 
structures, ordered magnetic phases, superfluid and su- 
perconducting states, etc. It is also common knowledge 
that upon heating the matter, the ordered phases melt 
into the familiar gaseous or liquid classical states that 
we encounter routinely in our everyday lives. A more 
specialized but equally well-established result is that no 
order that breaks a continuous symmetry can survive 
in one-dimensional systems [1], because quantum zero- 
point motion acts there similarly to thermal effects and 
"quantum-melts" ordered phases even at zero tempera- 
ture. 

It has been a long-standing and important ques- 
tion in physics whether quantum fluctuations in higher- 
dimensional quantum spin or boson systems can have 
the same debilitating effect, giving way to quantum liq- 
uids [2]. The interest in such a hypothetical spin liquid, 
also known as a Bose or spin metal [3], has experienced 
multiple revivals with the most prominent one associ- 
ated with the discovery of high-temperature supercon- 
ductivity [4, 5]. However, despite the decades of intensive 
search, no convincing examples of a gapless spin liquid 
have been found in any realistic two-dimensional quan- 
tum model. 

In models that are fermionizable via the Jordan- 
Wigner transformation [6, 7], the existence of spin liquids 
has now been firmly established [7, 8], but the physics 
there mimics somewhat the one-dimensional result [9- 
11]. What remains of crucial importance is whether a 
truly higher-dimensional spin system may host a quan- 
tum liquid. Among the influential recent results here are 
the stability argument by Hermele et al. [12], who showed 
that there is no fundamental obstacle to the existence of 
quantum spin liquids, and a complete classification of 
quantum orders by Wen [13], who demonstrated that an 
amazing variety of hypothetical gapless spin liquids can 
all be divided into several distinct classes, which include 



stable phases with low-lying fermionic spinon excitations 
that resemble a Fermi-liquid state. Also, the work of 
Motrunich, Fisher, and Sheng [14, 15] provides strong 
arguments in favor of the existence of such putative two- 
dimensional Bose metals and suggests that the strong 
singularity in the spin structure factor at a Bose surface 
is one of the hallmark phenomena of this exotic state. 

The main idea is that, despite the fact that the un- 
derlying particles are bosons, the collective behaviors in 
these strongly correlated Bose-metal states show a strong 
analogy to a Fermi liquid formed by fermionic particles. 
In a Fermi liquid, the fermion statistics dictate the forma- 
tion of Fermi surfaces, which possess singular behavior. 
In a Bose metal, despite the absence of Pauli's princi- 
ple, similar singularities also arise and define a surface 
in momentum space, known as a Bose surface [14, 15]. 
The existence of a Bose surface is the key property and 
most striking experimental feature of a Bose metal. How- 
ever, unlike a Fermi liquid, where the Luttinger theorem 
requires that the Fermi wave vector depends on the den- 
sity of fermions, the Bose wave vector in a Bose metal 
depends on the control parameters and can vary contin- 
uously even at fixed particle density. 

Here we provide strong evidence that a model as 
simple as the XF-spin model on a honeycomb lat- 
tice with nearest-neighbor (NN) and next-to-nearest- 
neighbor (NNN) interactions hosts, among other phases, 
a Bose metal with a clearly-identifiable Bose surface. Al- 
though, we came across this finding serendipitously, we 
would like to provide qualitative arguments that could 
potentially guide searches for other such interesting spin 
models. Note that the description of a spin Fermi-liquid- 
like state is necessarily a gauge theory [5, 16, 17], which is 
very similar to that of the Halperin-Lee-Read [18] quan- 
tized Hall (QH) state. In the latter gapless phase, the 
interacting electron system in a large classical external 
field gives rise to composite fermions in zero classical field 
but coupled to a fluctuating quantum field - the Chern- 
Simons field that implements flux attachment. The natu- 
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ral question here, considered before, e.g., in Refs. 19 and 
20, is whether a fractional QH state of this or any other 
type is possible in a sensible lattice model. 

The above remarks are relevant to our work because 
our simple Hamiltonian, see Eq. (1) below, can be viewed 
as a natural "trial model" for such a possible fractional 
lattice QH state per the following construction. Take the 
Haldane model [21] of noninteracting electrons on a hon- 
eycomb lattice with simple NN hoppings and complex 
NNN hoppings, 17216*"^. If (j) is nonzero it realizes a topo- 
logical insulator or lattice "integer" QH state. Replace 
the fermions with hard-core bosons at half-filling [22] and 
it becomes a promising strongly interacting model. No- 
tably, the most frustrated limit corresponds to = tt, 
which maps at half-filling to the following Hamiltonian 

H = J^ Y^iAh^ + H.c.) + J2 Y.{h\h^ + H.C.), (1) 

{ij) m 

where h\ {b-) is an operator that creates (annihilates) a 
hard-core boson on site i. Here, we require the sign of 
J2 to be positive (that is, (/) = tt), while the sign of Ji is 
in fact irrelevant because of the particle-hole symmetry 
of the honeycomb lattice {bi —bi for one of the two 
sublattices). In what follows, Ji = 1 sets our unit of 
energy. Note that Hamiltonian (1) maps to a frustrated 
anti-ferromagnetic-XF model {b] and b^ ^ S~), 

H = Ji Y.^StS- + H.c.) + J2 Y.^StS- + H.c). (2) 

{ij) m 

The properties of this Hamiltonian are governed by 
the dimensionless control parameter J2/J1. The limits 
of this model are well understood. For J2/J1 = 0, the 
ground state of this Hamiltonian is an antiferromagnet 
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FIG. 1: (Color online) (a) Phase diagram of the model 
in Eq. (1) as a function of J2/J1, (b) antiferromagnetic or- 
dering (phase I), (c) spin wave ordering with wavevector 
k = M (phase III), (d) collinear spin wave ordering with 
wavevector ]<. = K (phase IV). The phase boundaries are 
(J2/Ji)i^ii = 0.210 ± 0.008, (J2/Ji)ii^iii = 0.356 =1= 0.009, 
and (J2/Ji)iii^iv = 1.320 =b 0.020. 



[Fig. 1(b)]. When J2/J1 00, however, the ground state 
is a spin wave with 120° order [Fig. 1(d)]. Because the 
system is highly frustrated, there is a strong possibility 
of intermediate phases. In Fig. 1(a), we show the phase 
diagram for 24-site clusters as a function of J2 / Ji , finding 
two intermediate phases: (1) a quantum spin liquid and 
(2) an exotic spin wave state [Fig. 1(c)]. 

To pin down the phase boundaries, we consider the 
ground-state fidelity metric which has been shown to 
be an unbiased and sensitive indicator of quantum phase 
transitions [23, 24]. In Fig. 2(a), we show the fidelity met- 
ric for three different 24-site clusters [22, 25]. There are 
three peaks in ^, indicating three quantum phase tran- 
sitions. As we discuss in greater detail below, the three 
clusters have slightly different momentum space repre- 
sentations, resulting in the second and third transitions 
to occur at slightly different values of J2 / Ji for each clus- 
ter. 

Another indicator of a phase transition can be seen 
in the NN energy Ei (the NNN energy is denoted by 
E2). In Fig. 2(b), we show the ratio Ei/E (here E is the 
ground-state energy) for the 241^ cluster. The transition 
points are directly connected with the infiection points 
in Ei/E. To demonstrate this more clearly, we also show 
the derivative of Ei/E^ whose minima coincide with the 
transitions determined by the fidelity metric. 

From the mapping between spins and hard-core 
bosons, it follows that the antiferromagnetic and the 
other two ordered states correspond to Bose-Einstein 
condensates (BECs) in which bosons condense into quan- 
tum states with different momenta. To characterize these 
phases, we measure the condensate fraction fc = Ai/A'^ 
{Ni) is the total number of bosons) by computing the 
largest eigenvalue Ai of the one-particle density matrix 
pij = {b\b-). If fc scales to a nonzero value in the ther- 
modynamic limit, then the system exhibits Bose-Einstein 
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FIG. 2: (a) Fidelity metric vs J2/J1 for clusters 24C, 

and 2AE. (b) Ratio of the NN energy to the total energy 

Ei/E and its derivative (right axis) for the 24D cluster. 
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FIG. 3: (Color online) Finite-size scaling of the conden- 
sate fraction fc for parameters that are representative of each 
phase depicted in Fig. 1 (J2/J1 = 0.00, 0.30, 0.80, 00). The 
color of each curve is consistent with the color coding in Fig. 1. 
In the limit L ^ 00, the condensate fraction is nonzero in the 
antiferromagnetic, spin wave, and 120° ordered phases. 



condensation [26]. This is the case in three of our phases, 
as depicted in Fig. 3. For the Bose-metal phase, on the 
other hand, the condensate fraction vanishes in the ther- 
modynamic limit, indicating the absence of BEC. 

To further examine the properties of these phases, we 
calculate the single-particle occupation at different mo- 
mentum points 



n(k) = {aia^) + {^1/3^) . 



(3) 



Here, and are boson annihilation operators at mo- 
mentum k for the A and B sublattices. Because we are 
studying finite-sized clusters, we utilize twisted bound- 
ary conditions [27] and average over 40 x 40 boundary 
conditions to fully probe the Brillouin zone. 

In Fig. 4, we show the momentum distribution function 
as a function of k for select values of J2/J1 that are 




FIG. 4: (Color online) n(k) vs k for (a) the Neel state 
(J2/J1 = 0), (b-d) Rose metal (J2/J1 = 0.27, 0.30, and 0.32), 
(e) collinear spin wave (J2/J1 = 0.80), and (f) the 120° or- 
dered state (J2/J1 = 00). In (b-d), the Rose surface is indi- 
cated by the dashed red line and has a radius of magnitude 
ks = 0.9, 1.0, and 1.4, respectively. Each plot contains 19 600 
k points. 



representative of each phase. In the first phase [Fig. 4(a)], 
the momentum distribution function is sharply peaked 
at k = r, indicating an antiferromagnetically ordered 
state. The third and fourth phases [Figs. 4(e) and 4(f), 
respectively] also exhibit sharp peaks in n(k), but this 
time at the edges of the Brillouin zone. For phase III 
[Fig. 4(e)], n(k) is maximal at k = M, corresponding to 
the collinear spin wave state illustrated in Fig. 1(c). For 
phase IV [Fig. 4(f)], n(k) is maximal at k = i^, as one 
would expect for a 120° ordered phase [Fig. 1(d)]. 

The momentum distribution function in the Bose 
metal is depicted in Figs. 4 (b-d) for three different val- 
ues of J2/J1' One can see there that n(k) in this 
phase exhibits a remarkable J2/J1 -dependent Bose sur- 
face. Namely, the magnitude of the Bose wave vector ks 
at which the maxima of n(k) occurs changes (increases) 
with increasing J2/J1. The important distinction to be 
made here is that those maxima do not reflect Bose- 
Einstein condensation; i.e., they do not scale with the 
system size as the ones in the other three phases do. 

We should add that, in order to exclude other or- 
dering tendencies in phase II, we also examined the 



correlation function Cj 



and the dimer-dimer correlation function Dij^ki = 
{(Si • Sj)(S/e • S^)) and their corresponding structure fac- 
tors. Finite-size scaling of these structure factors (not 
shown) made evident that neither charge density wave 
formation nor dimer formation occurs. We also com- 
puted the excitation gap in the Bose-metal phase and 
found it to be much smaller than the (finite-size) exci- 
tation gap in the antiferromagnetic state. In the anti- 
ferromagnetic phase, the system is gapless in the ther- 
modynamic limit, due to the spontaneous breaking of 
the spin-rotation symmetry and the resulting Goldstone 
modes. Since the gap in the Bose-metal phase is signifi- 
cantly smaller, we believe this gap is also due to finite-size 
effects and will close in thermodynamic limit. Our small 
system-sizes prevent us from reaching conclusive results 
for this quantity after a finite-size extrapolation. Never- 
theless, all the phenomena we observed in this phase are 
consistent with and indicate a Bose-metal phase. 

In Fig. 5, we illustrate how both the momentum 
distribution function and the largest eigenvalue of 
{oi\oij + evolve over the entire parameter space 

for two different 24-site clusters with periodic boundary 
conditions. The maximum of n(k) perfectly matches Ai, 
and it is clear that the momenta of the condensates in 
phases I, III, and IV are k = F, M, and respectively. 
In addition, it can be seen that the momentum distribu- 
tion in phase II exhibits a peak inside the Brillouin zone 
that shifts to larger momenta as J2/J1 is increased. 

Phases III and IV exhibit an interesting phenomenon 
that can be unveiled by examining the degeneracy of the 
largest eigenvalues of the one-particle density matrix. In 
an ordinary BEC state, condensation occurs to a unique 
effective single-particle state, and thus the largest eigen- 
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FIG. 5: (Color online) Momentum distribution function 
(symbols) for the different values of k and clusters (a) 24C 
and (b) 24L). Also shown are the largest eigenvalue Ai of the 
single-particle density matrix (line). The inset of each panel 
illustrates the k-points for each cluster. 

value of the density matrix is nondegenerate and 0(A^5), 
while the second largest eigenvalue is already 0(1). This 
is what we find in the antiferromagnetic state (phase 
I). However, in general, condensation can occur to more 
than one effective one-particle state [28, 29], and various 
largest eigenvalues of the one-particle density matrix may 
become 0{Ni)) and degenerate. This fragmentation oc- 
curs in phases III and IV. For phase IV, it is trivial to re- 
alize that the condensate must be degenerate in the limit 
J2/J1 00, where the system consists of two discon- 
nected triangular lattices. Interestingly, in this model, 
fragmentation occurs for all values of J2/J1 in phases III 
and IV, and is related to the number of M or K points 
present in the clusters under consideration. 

In summary, we have studied a frustrated XY model 
on a honeycomb lattice. We find that this model exhibits 
four phases [see phase diagram in Fig. 1(a)]: (I) a BEC 
at k = F (antiferromagnetism), (II) a Bose metal (spin 
liquid), (III) a BEC at k = M (a collinear spin wave), 
and (IV) a BEC at k = K (120° order). The Bose-metal 
phase is characterized by a parameter dependent peak in 
n(k) and a lack of condensation, solid order, and dimer 
order. This work provides the first convincing example 
of a gapless spin liquid in a surprisingly simple model 
of XY spins. We believe that there is no fundamental 
challenge to realize the Bose-metal phase in experimental 
systems dealing with spins or ultracold optically trapped 
bosons in the regime of large on-site Hubbard repulsion. 
Finally, recent experimental [30] and theoretical [31-34] 
work suggest that exotic quantum spin liquids might exist 
in related lattice models for SU(2) spins. It would be 
interesting to see what relationship, if any, exists between 
these possible SU{2) spin liquids and our Bose metal, 
which can be studied by introducing interaction terms 
for the bosons. 
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